arXiv:1506.08360vl [math.OC] 28 Jun 2015 


Optimal financing and dividend distribution in a general 
diffusion model with regime switching 


JiNXIA ZHU 

The University of New South Wales, Australia 

Hailiang Yang 

The University of Hong Kong, Hong Kong 


Abstract 

We study the optimal financing and dividend distribution problem with restricted div¬ 
idend rates in a diffusion type surplus model where the drift and volatility coefficients are 
general functions of the level of surplus and the external environment regime. The en¬ 
vironment regime is modeled by a Markov process. Both capital injections and dividend 
payments incur expenses. The objective is to maximize the expectation of the total dis¬ 
counted dividends minus the total cost of capital injections. We prove that it is optimal to 
inject capitals only when the surplus tends to fall below zero and to pay out dividends at the 
maximal rate when the surplus is at or above the threshold dependent on the environment 
regime. 
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1 Introduction 


The optimal dividend strategy problem has gained extensive attention. In the diffusion setting, 


many works conce rning dividenc 


cashffow process. 


optimization use the Brownian motion model for the underlying 


Bauer lei (120041 ) extends the b asic model by assuming that the drift coefficient 


is a linear function of the level of cashffow and 
model and solves the optimization problem. 


Cadenillas et ah 


Hoigaard and Taksar 


(I 2 OO 7 ) use s the mean-reverting 


(1200111 considers the opti¬ 


mization problem under the model where the drift coefficient is proportional to the level of 


cashffow anc 


Shreve et al 


the d i ffusion coefficie n t is proporti onal to the square root of the cashffow level. 


(Il984h . 


Paulsen! (1200811 . 


Zhu 


(l2014bl) and some references therein address the opti¬ 


mization problems for the general diffusion model where the drift and diffusion coefficients are 
general functions of the cashffow level. 

An interesting and different direction of extension is to include the impact of the changing 
external environments/conditions (for example, macroeconomic conditions and weather condi¬ 
tions) into modeling of the cashflows. A continuous time Markov chain can be used to model the 
state of the external environment condition, of which the use is supported by observation in fi¬ 


nancial markets. The optimal dividend problem with regular control for Markov-modulated ris. 

lillaJ 


processes has been investigated under a verity of assumptions. 


Sotomavor and CadenillasI (j201lfl 


solves the dividend optimization problem for a Markov-modulated Brownian motio n model wit 


both the drift and diffusion coefficients modulated by a two-state Markov Chain. 


Zhnl (!2ni4all 


solves the problem for the Brownian motion model modulated by a multiple state Markov chain. 
The optimality results in all the above works imply that distribut i ng div idends according to 


the optimal strategy leads almost surely to ruin. 


Dickson and WatersI (1200411 proposes to include 


capital injections (financing) to pr event the surplus becomes negative and therefore prevent 


ruin. Under the Brownian motion, 


and financing problem, and 


Lokka 


and ZervosI (120081 1 investigates the optimal dividend 


He and Liangl (l2008l) studies the problem with risk exposure control 


through control of reinsurance rate. The optimality problem with control i n both capital injec- 


tions and dividenc 


(l 20 nll . 


Yao et al. 


distri bution in a Cramer-Lundberg model is addressed in 


Scheer and Schmidli 


(I 2 OIII) solves the problem for dual model with transaction costs. 
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The purpose of this paper is to investigate optimal hnancing and dividend distribution prob¬ 
lem with restricted dividend rates in a general diffusion model with regime switching. Under the 
model, the drift and volatility coefficients are general functions of the level of surplus and the 
external environment regime, which is modeled by a Markov process. Similar to the “reflection 
problem”, the company can control the hnancing /capital injections process (a deposit process) 
and the dividend distribution process (a “withdrawal” process). Both capital injections and div¬ 
idend payments will incur transaction costs. Sufficient capital injections must be made to keep 
the controlled surplus process nonnegative and the dividend payment rate is capped. This paper 
can be considered as an extension of the existing works on the dividend optimization problem 
with restricted dividend rates for the diffusion models with or without regime switching. The 
model considered is more general as it assumes that 1. the drift and volatility are general func¬ 
tions of the cashhows; and 2. the model risk parameters (including drift, volatility and disconnt 
rates) are dependent on the external environment regime. 

The rest of the paper is organized as follows. We formulate the optimization problem in 
Section 2. An auxiliary problem is introduced and solved in Section 3. Section 4 presents the 
optimality results. A conclusion is provided in Section 5. Proofs are relegated to Appendix. 

2 Problem Formulation 

Consider a probability space P). Let {Wt]t > 0} and > 0} be respectively a 

standard Brownian motion and a Markov chain with the hnite state space S and the transition 
intensity matrix Q = {qij)ij£s- The two stochastic processes {Wt;t > 0} and > 0} are 
independent. We use > 0} to denote the minimal complete a-held generated by the 

stochastic process > 0}. Let Xt denote the surplus at time f of a hrm in absence of 

hnancing and dividend distribntion. Assume that Xq is Xq measurable and that Xt follows the 
dynamics, dX* = ^{Xt-,^t-)(it + a{Xt-,^s-)(iWt for t > 0, where the functions /i(-, j) and cr(-,j) 
are Lipschitz continuous, differentiable and grow at most linearly on [0, cxd) with / j .( 0 , u ) > 0. 
Fnrthermore, the fnnction /i(-, j) is concave and the fnnction o'(-, j) is positive and non-vanishing. 

The hrm must have nonnegative assets in order to continne its business. If necessary, the 


3 



firm needs to raise money from the market. For each dollar of money raised, it includes c dollars 
of transaction cost and hence leads to an increase of 1 — c dollars in the surplus through capital 
injection. Let Ct denote the cumulative amount of capital injections up to time t. Then the total 
cost for capital injections up to time t is The company can distribute part of its assets to 
the shareholders as dividends. For each dollar of dividends received by the shareholders, there 
will be d dollars of cost incurred to them. Let Df denote the cumulative amount of dividends 
paid out by the company up to time t. Then the total amount of dividends received by the 
shareholders up to time t is We consider the case where the dividend distribution rate 
is restricted. Let the random variable denote the dividend payment rate at time s with the 
restriction 0 < /s < Twhere l{> 0) is constant. Then Dt = Igds. Both Ct and Dt are controlled 
by the company’s decision makers. Dehne tt = {{CtiDt)C > 0}. We call tt a control strategy. 

Taking hnancing and dividend distribution into consideration, the dynamics of the (con¬ 
trolled) surplus process with the strategy tt becomes 

dX," = (/r(X7_, 6-) - lt)dt + a{Xt,it-)dWt + d^, t > 0. (2.1) 

Dehne P(a;,i) ( ■ ) = P ( ' = a;, = *), [ • ] = E [ • |Xo = x, = *], Pi ( ■ ) = P ( ' l^o = *), 

and Ej [ • ] = E [ ■ |'Co = *] • The performance of a control strategy tt is measured by its return 
function dehned as follows: 

poo 1 poo 

R^{x,i) ='E(^x,i) / - dCt ,a;>0,fe5, (2.2) 

Uo 1 +« Jo 1 - c J 

where (j^^ds with 5^^ representing the force of discount at time s. Assume > 0, f G 5. 

A strategy tt = {(Ct, Dt);t > 0} is said to be admissible if (i) both {Cf, t > 0} and {Dt] t > 0} 
are nonnegative, increasing, cadlag, and {iFt]t > 0}-adapted processes, (ii) there exists an 
> 0}-adapted process {lt]t > 0} with It G [0,1] such that Dt = /J/sds and (iii) > 0 
for alH > 0. We use If to denote the class of admissible strategies. 

Since {Ct]t > 0} is right continuous and increasing, we have the following decomposition: 

Ct = Ct + Ct — Ct-, where {Ct; t > 0} represents the continuous part of {Ct; t > 0}. 

For convenience, we use X, X'^, ^ and {X'^,^) to denote the stochastic processes {Xt]t > 0}, 
{X^]t > 0}, {.^t; ^ > 0} and {{X{{, ^t)]t > 0}, respectively. Note that for any admissible strategy 
TT, the stochastic process X'^ is right-continuous and adapted to the hltration [Xt'C > 0}. 
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The objective of this paper is to study the maximal return function (value function): 


V(x, i) = sup Rn{x, i), 

ttGII 

and to identify the associated optimal admissible strategy^ f 


ment in stochastic control theory (e.g. 


Fleming and Sonerl . 


any. 


(2,3) 


Following the standard argu- 


19931) . we can show that the value 


function fulhls the following dynamic programming principle: for any stopping time r, 


V(x, i) = sup 

ttGII 


1 r e-^‘ 

dt — / - 

Ljol + n Jo ^ ~ c 


da + e-^^E(x;,e;) 


(2.4) 


3 An Auxiliary Optimization Problem 


Motivated bv I Jiang and PistoriusI fl 2012 l) . which introduces an auxiliary problem where the ob¬ 
jective functional is modihed in a way such that only the “returns” over the time period from 
the beginning up to the first regime switching are included plus a terminal value at the moment 
of the hrst regime switching, we start with a similar auxiliary problem hrst. The optimality 
results of this problem will play an essential role in solving the original optimization problem. 

Throughout the paper, we dehne 5 = min^g^^j, qi = —and ai = inf{t > 0 : 7 ^ .^o}- 
Here, cxi is the hrst transition time of the Markov process For any function g : x iS —)■ M+, 
we use g\-) and g'\-) to denote the hrst order and second order derivatives, respectively, with 
respect to the hrst argument. We start with introducing two special classes of functions. 

Definition 3.1 (i) Let C denote the class of functions g : x iS — )■ M such that for each 

j G S, g{-,j) is nondecreasing andg{-,j) < (H) LetV denote the class of functions g eC 

such that for each j G S, g{-,j) is concave and ^ 0 < x < y. (Hi) Define the 

distance\\■ \\ by\\f - g\\ = max^>o^i^s\f{x,i) - g{x,i)\ forf,geV. 


Lemma 3.1 The metric space {V, 


is complete. 


Dehne a modihed return function and the associated optimal return function by 
IJQ 1 + d Jo i — c 




-dt 


r-i g-At 




, X > 0, i G iS, 


Vf{x,i) =sup Rf^Tr{x,i), X > 0,i E S. 

ttGII 


(3.6) 

(3.6) 
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Lemma 3.2 For any f e C, V,Vf e C . 


Notice that the un-controlled process {X, is a Markov process. For any f & C and any i G iS, 
the following Hamilton-Jacobi-Bellman (HJB) eqnation for the modihed valne fnnction Vf{-,i) 
can be obtained by using standard arguments in stochastic control; for a: > 0 
max{ max;g[oji + y{x,i)Vj-{x,i) - 6iVf{x,i) + l - Vj:{x,i)J^ ,Vl(x,i) - = 0. 

Now we dehne a special class of admissible strategies, which has been shown in the litera¬ 
ture to contain the optimal strategy for the original optimization problem if there is 1 regime 
only. Since the return function of the modihed optimization includes the dividends and capital 
injections in the hrst regime only, this problem can be considered as a problem to maximize 
the returns up to an independent exponential time for a risk model with 1 regime. It is worth 
studying the special class of strategies mentioned above to see whether the optimal strategy of 
the modihed problem falls into this class as well. 


Definition 3.2 For any b > 0, define the strategy 7r°’^ = D^'^fit > 0} in the way such 

that the company pays dividends at the maximal rate I when the surplus equals or exceeds b, pays 
no dividends when the surplus is below b and the company injects capital to maintain the surplus 
at level 0 whenever the surplus tends to go below 0 without capital injections. 


We now investigate whether a strategy with an appropriate value for b is optimal or not 
for the modihed optimization problem. We start with studying the associated return functions. 
For convenience, we write = X'"°'^ throughout the rest of the paper. 

Remark 3.1 (i) It is not hard to see that is admissible and that both and X^'^ are 
Markov processes, (ii) For any function f E C and any i E S, by applying the comparison 
theorem used to prove the non-decreasing property ofV{-,i) and Vf{-,i) in Lemma [Ql we can 
show that the function Rf^T,o,b{-,i) is non-decreasing on [0, oo) as well. 

For any f E C, i E S and & > 0, dehne the operator Aj^i^b by 

Af,i,b g{x) = ^ + {^i{xfi) - l)g'{x) - {5i + qi)g{x) + = 0.(3.7) 
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The following conditions will be required for the main theorems. 


Condition 1: The functions and are the ones such that for any given function 

f E T> and any given i E S, the ordinary differential equation Af^i^b g{x) = 0 with any hnite 
initial value at a: = 0 has a bounded solution over (0, oo). 

A sufficient condition for Condition 1 to hold is that bo th the functions and 


are bounded on [0, oo) (see Theorem 5.4.2 


m 


KrvlovI fjl996l) b However, this is far away from 


necessary. For example, when is a linear 

constant Condition 1 also holds (see section 4.4 of 


unction wi 


ZhnI (I2ni4bh b 


h positive slope and is a 


Condition 2; < Si for all a; > 0 and i E S. 

Dehne for any function f E C and i E S, 




Qi + Si 


(3.8) 


Lemma 3.3 Suppose Condition 1 holds. For any function f E V , anyi E S, (i) the function 
Rf .j,o,b{-,i) for any b>0, is a continuously differentiable solution on [0, oo) to the equations 

^ + p.{xC)g'{x) - {Si + qi)g{x) + ^qijf{xA) = 0, 0 < a: < 6, (3.9) 

^-^^/(a;) + {fr{x,i) - l)g'{x) - (Si + qi)g(x) + j) = - ^ (3.10) 

5''(0+) = lim g(x) < oo, (3.11) 

and is twice continuously differentiable on (0,6) U (6, oo); (ii) the function hf^i(b) := R'j:^o,,(b,i) 
is continuous with respect to b for 0 < 6 < oo. 

Throughout the paper, we use ^g(x,i) and ^g(x,i) to represent the derivatives of g from 
the left- and right-hand side, respectively, with respect to x. 


Corollary 3.4 Suppose Condition 1 holds. For any f E V, i E S and b>0, (i) Rf ,^o,b(-,i) 
is increasing, bounded, continuously differentiable on ( 0 ,oo), and twice continuously differen¬ 
tiable on (0,6) U ( 6 , oo) with R'oA^+c) = = hm^ibi?" 0 , 5 ( 3 :, f) and 

^R'^,^o^f,(x,i) = hm 2 , 4 ,fei?"^o, 6 (a:,f); and (li) if R'j,^^o,b(b,i) = then Rf^.„o,b(x,i) is twice 

continuously differentiable with respect to x at x = b. 
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We use i) and i?"^o,6(0,i) to denote i?^^o,6(0+,i) and R"^o^i,{0+,i), respectively. 


Lemma 3.5 Suppose Conditions 1 and 2 hold. For any fixed f G V, i E S and b > 0, we 
have R'f o,o(0+,i) < 0, and in the ease b > 0, R'i o6(0+,i) < 0 if Rh obib,i) < t^. 

Lemma 3.6 Suppose Conditions 1 and 2 hold. For any f eV and i E S, (i) R”^o^o{x,i) < 0 
for a; > 0, and in the ease b > 0, R'j.^o^b{x,i) < 0 for a; > 0 if R'j,^o,b{b,i) = and (ii) for 
b>0, if R'j.,^o^b{b,i) > R’j^^^o,b{x,i) <0forxE [0,6) and 0) < 0. 

Let /{■} be the indicator function. Define for any fixed 6 > 0 and any fixed tt G II, 


rf = inf{t > 0 : Xf > 6}, 

^r^Acri 

I / 

ttGII 

-A 


(3.12) 


Wf^b{x,i) = supE(,^,i) 


-As 


-ds 


A(T1 1 

-dW 


'0 


^ + d Jq 1 — c 

+ e-^-:< <^i} + < A'} 


(3.13) 


Theorem 3.7 Suppose Conditions 1 and 2 hold. For any f eT>, any i E S and any b > 0, if 
R'j^^o,b{b,i) > then R'j^^oA^c) > for 0 < x < b and Rf^^o,b{xfi) = Wf^b{xfi) for x > 0. 

We show in the following theorems that if b is chosen appropriately, the return function for 
the strategy coincides with the optimal return function of the modihed problem. 


Theorem 3.8 Suppose that Conditions 1 and 2 hold. For any f E V and any i E S, (i) 
if R'j then Vf{x,i) = Rf^T,o,o{x,i) for x > 0; and (ii) if for a fixed b > 0, 

R^^oxibC) = then Vf{x,i) = Rf^^o,b{x,i) for x > 0. 

Lemma 3.9 Suppose Conditions 1 and 2 hold, f E V and i E S. Let i?'^^o,o(0,i) denote 
R'j^^o,o{0+,i). If R'j,^^o,b{b,i) > for all b>0, then Vf{x,i) = limb^oc, Rf,^ox{x,i) for x > 0. 

Again we use R'j,^o,o{0,i) to denote i?^^o,o(0+,i). Dehne for any f eT> and i E S, 

b{ = oo if R'j^o^b{b,i) > for all 6 > 0 , and b{ = inf{6 > 0 ; R'^^Q^fibfi) < otherwise. 

(3.14) 

We show in the following that the strategy tt^’L is optimal for the modihed problem. . 


Theorem 3.10 Suppose Conditions 1 and 2 hold. For any f E V and any i E S, (i) 
0 < 6f < oo; and (ii) Vf{x, i) = R {x, i) for a; > 0. 



4 The Optimality Results 


We use the obtained optimality results for the modihed optimization problem to address the 
original optimization problem. The starting point is to notice that the optimal return function 
of the original optimization Vf, when the hxed function / is chosen to be the value function of 
the original optimization, coincides with the value function V. 

Theorem 4.1 If Conditions 1 and 2 hold, (i)V G V; (ii)bY < oo andV{x,i) = o ,,Y{x,i). 

Theorem 4.2 Define 71* to be the strategy under which, the dividend pay-out rate at any 
time t is and the company injects capital to maintain the surplus at level 0 whenever 

the surplus tends to go below 0 without capital injections. If Conditions 1 and 2 hold, then 
V{x,i) = V'^*{x,i) i E E and the strategy tt* is an optimal strategy. 


5 Conclusion 


We have addressed the optimal dividend and hnancing problem for a regime-switching general 
diffusion model with restricted dividend rates. Our conclusion is that it is optimal to inject 
capitals only when necessary and at a minimal amount sufficient for the business to continue, and 
to pay out dividends at the maximal rate, I, when the surplus exceeds the threshold dependent 
on the environmental state. This result is consistent with the hndings for similar problems under 


simpler model conhguration in the literature. For example, the opt imal str a 


dividend rates is o 
diffusion ("see 


thres hold type for the Brownian motion (see 


Taksarl ( 2000 


egy with restricted 


Zhul (|2014b|)), and the regime-switching Brownian motion (see 


Zhu 


, the 


general 


(l2014alB . 


APPENDIX 


A.l Proofs for Sections [3] and |4] 


For any i E S and b > 0, dehne the operator B by 


B g{x,i) = 


a^(x, i] 


g"{x, i) + n{x, i)g\x, i) - 6ig{x, i) 


(A-1) 
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Proof of Lemma 13. II Consider any convergent sequence {gn, n = 1, 2, • • ■ } in D with limit g. It 
is sufficient to show g E V. As for any hxed i and n, gn{-, i) is nondecreasing and concave, so is the 
function g{-,i). The inequality g{-,i) < s{i+d) follows immediately by noticing gn{-,i) < 5 {i+d) • 
It remains to show that <; 0 < x < y. We use proof by contradiction. 

Suppose that there exist xq, yo with 0 < xq < |/o and j such that Dehne 

Co := I • Clearly, cq > 0. As gn converges to g, we can hnd an iV > 0 such 

that for all n> N, \\gn - 9\\ < eo(l/o - a^o)- Therefore, \gn{yoJ) - 9{yoJ)\ < eo(l/o - Xq) and 
\ 9 nixoJ) - 9ixoJ)\ < eo{yo - xq). As a result, 9niyoJ) - 9 nixo,j) > yiyoJ) - eo(2/o - xo) - 
(yixoJ) + eoiyo - Xq)) = yiyoJ) - 9ixo,j) - 2eo{yo - Xq) = On the other hand, we have 

gn{yo,j)-gn{xo,j) ^ ^ ^ py jg ^ contradiction. □ 

Proof of Lemma 13.21 Noting that Is < I and that ui is exponentially distributed with mean T 
and As = 6iS for s < Ui, the upper-bounds follow easily from fl2.2l) . fl2.3|) and fl3.6p . 

Fix X and y with y > x > 0. Let {X^;t > 0} and {X^;t > 0} denote the surplus processes 
in absence of control with initial surplus x and y, respectively. We use vr* = {(Cf, Df) : t > 0} 
with Df = Jq Isds to denote any admissible control strategy for the process {Xf;t > 0}. 
Noting that {Cf; t > 0} is right-continuous and increasing, we have the following decomposition: 
Cf = /o efds + Eo<s<i(C's - Q_). Dehne Co = 0, Ci = ffif{s > 0 : Q - >0 or C. ^ 

Cs-} and Cn+i = {s > Cn : - C^_ >0 or Cs 7^ C^-} for n = 1,2,---. Note that Ci = 

for t e [Cn,Cn+i) and hence, Cc„) - It + et)dt + C<„)dIW and 

dXr^ = (/i(Xr^CcJ - If + ef)dt + c^(Xr^CcJdlfoi for t E (Cn,Cn+i),ri = 0,1,---. By 
noting Xq'^ = Xq = x < y = Xq = Xj j’^ and applying the c ompa. rison theorem for solutions 


of stochastic differential equations (see 


Ikeda and Watanabd (119771) 1. we can show that with 


probability one, Xf’^ < X\'^ for t E [0, Ci)- Further notice that any discontinuity of a surplus 
process is caused by a jump in the associated process at the same time and hence, X^^'^ = 
XX,n^ + < Xl^^ + -C'ci-) = probability one. As a result, by applying 

the comparison theorem on (Ci,C 2 ) we can see Xf'^ < X\'^ for t E (Ci,C 2 ) with probability 
one. Repeating the same procedure, we can show that Xf'"" < Xf’^ for t E (Cn, Cn+i] with 
probability one. In conclusion, Xf’'^ < Xf'"^ for all f > 0 with probability one. Therefore, vr^ 
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satisfies all the requirements for being an admissible strategy for the risk process and hence, 
< Vf{y,i) and RT,x(y,i) < V{y,i). Using this and fl3.5p we can show Rf^Tr^{x,i) < 
Rf,TT^{yyi) < Vf{y,i). Similarly we can obtain i) < V{y,i). By the arbitrariness of tt^, we 

conclude that Vf{x,i) < Vf{y,i) and V{x,i) < V{y,i) for 0 <x <y. □ 

For any f E C and i E S, dehne the function : R x iS —)■ R by 

= Rf^^o.b{-,i) and j) = /(•, j) if j 7^ i. (A-2) 


Lemma 5.1 For any f E C and i E S, suppose the function Wf^i : R x 5 —)■ R with 
'^fA'yj) — fi'A) if 3 A b bounded, continuously differentiable and piecewise twice con¬ 
tinuously differentiable with respect to the first argument on [0, 00), and the function Wffi -, i ) 
satisfies the ordinary differential equations 03.91) and 03.101) . Then, for any vr G If, there exists 
a positive sequence of stopping times {r„; u = 1, 2, • • • } with lim„^oo t„ = 00 such that 


Wffixfi) = E( 3 ,,i) 


E 


{ x , i ) 


pTn/\a\/\t 

Jo 

CTnAcTlAt 


Y, e-"- (w„(x:,(..-) - ?.-)) + / 6-)dq 


E 


{ x , i ) 


0 <s<TnA(TiAi 

TnA(7lAt -I 


> 6}di! 


L70 1 + d 

Proof. Note that Applying Ito’s formula yields that 


(A-3) 


E(a;,i) 


g ^T-„Ao-iAt) '^fA-^oAo) 


— Ii F I2 F I3 F R{x,i) 


Y («’/,<(AT-. A) - «>/,i(A7_, A-)) 


0<s<t„A(ti At 


(A-4) 


where h = E(2,_p 




12 — E(3;^j) 

13 = 


jrMt e-''-a(X;_,i,Vn.p{X;_,i,V<iW, 


and 


e-"- («>/,i(A7. A-) - A-)) + 1;- ' f.-)dC 

Notice that the stochastic processes 

/o e-'^*a(X;_,^,_)M;}_.(XJ_,^,_)dlU, and /p (^qiWpi{Xf_,fs-) - ds+ 

,7is) — wj j(XJ_, are P(a;_i)-local martingales. Hence, we can always 
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find a positive sequence of stopping times [rn] n = 1 , 2 , • • ■ } with lim„^.oo Tn = oo such that both 

and 

- Y. j^i f ,i{X^s-J)) 

+ Zlo<s<tAr„ - Wf^i{X^_,is-)) are P(a,^i)-martingales. Then it follows by the 

optional stopping theorem that 


^2 


ptArn A(Ji 


e-^“a(X;_, ^s-Wf,AX:.,^s-)dWs 


E 


{x,i) 


I JO 

ctATnAai 


= 0 , 


(A-5) 


L -'0 


e ( qiWf^i{XY,^s-) -'^qijWf^i{XY,j) ) ds 




+ { wf ,{ X:_,Q - Wf ,{ x :_, e,_)) 


= 0 . 


(A- 6 ) 

0<S<tATnai 

'Noting that XJ — XJ_ = Cg — Cg- > 0, ^g- = i, and (^ 5 _) = Wf^i{Xg_,i) for 

s < CTi given ,^o = h that the function Wf^i{-,i) satishes both fl3.9p and fId.lOp , and that 
= fii'J) if j A h we obtain that for s < A cxi, Bwf^i{XYAs-) = qiWf^i{XYAs-) + 
Kw'fA^AAs-) - j^)I{X^_ > b} - which combined with (jA31), (jH), 


(IA- 6 D and E( 3 ._q 


'i^fA^SAo) 


= Wf^i{x,i) implies the hnal result. □ 

Proof of Lemma 13.3h ii Let ni(-; i) and V 2 {-', i) denote a set of linearly independent solutions to 
the equation AAA) ~ {A + qi)g{x) = 0, and V 3 {-;i) and vY; i) denote a set of 

linearly independent solutions to the equation —j^g"{x) + (/i(a;, i) — l)g'{x) — {6i + qi)g{x) = 0. 
Dehne Wi{x]i) = Vi{x]i)v 2 {xA) — V 2 {xA)AA'A)) W 2 AA) = v^AiAAAA) — Vi{x]i)v'.^{x]i), 
B.(x; i) = V,(X-,,) /; - ,„(x;») £ and 

v,{y;i) 2 f/(l +<i) + Ej#.' 


B2{x]i) = V‘i{x]i) 

- VA{x]i) 


0 W2{y]i) 
vz{y]i) 2 


a‘^{y,i) 

+ d) + Yj^i 


dy 


dy. 


Jo W2iy;i) cr^iyA) 

Then for any constants Ki,K 2 ,K^ and X 4 , the functions, KiVi{-;i) + K 2 V 2 {-;i) + and 

XsVs^'A) + A' 4 n 4 (-;i) + are solutions to the equations fl3.9p and fl3.10p . respectively. 

Dehne the function g^i by gbAA — XiVi{x-, i) + K 2 V 2 A') A + Bi{x] i) ioi t) < x <h and gbAA — 
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KsVsix'ji) + K4Vi{x]i) + B2{x]i) for x >h, where Ki, K2, and are constants satisfying 

Kivi{h-, i) + K 2 V 2 {b-, i) + Si(6; i) = K^vsib; i) + i) + ^2(6; i), (A- 7 ) 

KWAb- i) + K 2 v'Ab] i) + B'Ab- i) = K^v'^b] 1) + K^v'^b] 1) + 5 '(6; 1), (A-8) 


Ain^( 0 ; i) + K2v'2{A] i) = -x ——, lim [K-^vAx] i) + K^vAx', i) + -82(2^; A) < 00. (A- 9 ) 

1 — C X—>-oo 

For 6 > 0 , we can easily verify that 5't,^j(0+) = and that gb,i{') continuonsly differentiable 
on [ 0 , 00) and twice continuously differentiable on [ 0 , 6 ) U (6, cxd). Hence, the existence of a 
solution with desired property has been proven. 

It suffices to show Rf .j,o,b{x,i) = QbA^) for x > 0 . Dehne Wf^i by 


= gbA^) if J = * and, Wf^xJ) = f{x,j) if j A i- 


(A-10) 


Note that the process, will always stay at or above 0 and the company injects capital only 
when the process reaches down to 0 with a minimal amount to ensure that the surplus never 
falls below 0 . Further note that = ^0 for s < cti. Hence, we conclude that the process ( 7 °’^ 
is continuous and that given = i, the following equations hold for s < cxi. 


xr = xAA + (cr - c^s’-) = ^s-) - wAxAA^s-) = 0 

dCO’^ 


«^'(x^^e.-)dC'r = <.(o)dcr = 


(A-ll) 

(A-12) 


By applying Lemma lATl we know that for some positive sequence of stopping times {r„;n = 
1 , 2 , ••■} with lim„_j.oo'rn = 00, the equation flA -311 holds. Then by setting vr = 7r°’^ in (IA- 3 p . 
noticing that the dividend payment rate at time s is lI{XgA > b} under the strategy 7r°’^ and 
that gb,iA) — and using flA-lip and flA- 12 p . we arrive at 


gb,iA) ~ E(3;^j)[e ^''"'''^f,i{XaiATnAtAuiATnAt)]~\~R(x,i) 


rcriATnAt ^g-A, 


L Jo 


1 + d 


liXA’’ > b}ds 


r-O-lATnAt g-A, 


L-'O 


1 - X‘ 


(A-13) 


Note that the function WfA'i') is bounded. By letting t —)■ cx) and n —>■ 00 on both sides of 
flA- 13 p . and then using the dominated convergence for the hrst expectation on the right-hand 
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side and the monotone convergence theorem for the other expectations, we can interchange the 
limits and the expectation and therefore can conclude that gb,i{x) = Rf .,^o,b{x,i) for x > 0. 

(ii) Note by fld.Sp that lim 3 ,_,.oo Rf,TrO>t>{x,i) == Af^i, where the second last 

equality follows by noticing that given Xq = x, ^ oo as x ^ oo and hence (7°’^ —?• 0 as 
X —)■ oo, and the last equality follows by noting that, given (Xo,.^o) = ai is exponentially 

distributed with mean and using the dehnition of Ajj in 03.81) . So the constants Ki,K 2 -,K^ 
and 7^4 are solutions to the system of linear equations 0A-7P - 0A-9I) and K^v^{oo) + K^ViiyOo) + 
i? 2 (oo) = Af^i. Note that the coefficients of the above system of equations are either constants 
or continuous functions of b. Hence, Ki, K 2 , and are continuous functions of b, denoted 
by Ki(b), K 2 {b), K^{b) and K^^b) here. As a result, the function hf^i{b) = gli{b) = Ki{b)v[{b) + 
K 2 {b)v 2 {b) + B[{b;i) is continuous for 0 < 6 < 00 . □ 

For any f E C, i E S and b > 0, define the functions h and h by 


hf,i,b{x) = (Si + qi)Rf^^o,b{x,i) - iJ,(x,i)R'f .^o,b(x,i) - j) 

j¥=i 

^ ^ “ ^'f,noAx,i)] I{x > b}, 


(A-14) 


hf,i,b(x) = (Si + qi)Rf^^o,b(x,i) - iJ,(x,i)R'j:^^o,b(x,i) -^qijf(xj) 

j¥=i 

I (I{x> b}. 


(A-16) 


Proof of Corollary 13.41 (i) is an immediate result of Remark 13.11 and Lemma [3.31 (i). (ii) By 


(i) and Lemma IX^ ii we have ^R'j. ^o^h(x,i) 
lim^ift ■ By noting R'^A^, we conclude 


X=b 0 - 2 ( 6 ,*) 






dx /,7r' 




x=b 


x=b 


dx /,7r' 


. x=b 


□ 


For any sequence {yn}, define 


1 ( ■ ( W /r L ’( -WW ( V fiVnA) — f(x,j) 

kf^b(x,i; {yn]) = (a* + g* - /i (x,i))R.o,b(xA) - > Aij Bm 

’ f ^ n .— 




yn - X 


(A-16) 


Proof of Lemma 13.51 Throughout the proof, we assume f E R, i E S and & > 0, unless stated 
otherwise. We use proof by contradiction. Suppose R"^o^b(0+,i) > 0. 
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Since Rf^.„o,o(-,i) is bounded, we can find a large enough x such that R'j^o,o{x,i) < = 

-R^^o,o(0+, i), where the last equality is by Lemma I3l3] fib Hence there exists an a: > 0 such that 
R'f o,oix,i) < 0. In the case 6 > 0, notice that R'r o6(0+,i) = > R'r So for 6 > 0 

there exists an x G (0,6) such that R'j.< 0. Define Xi = inf{x > 0 : R"^o,bix,i) < 0}. 
Then xi > 0 in the case 6 = 0 and xi G (0, 6) in the case 6 > 0, and for 6 > 0, 


R'f,nO,biXl,i) 


0, > 0 for X G [0,xi). 


(A-17) 


As a result, for 6 > 0, 


R'j.^o,b{x,i) > R'j:,^o.b{0+,i) = - - for x G ( 0 ,Xi]. 


(A-18) 


Write Rf .^o,b i{x) = Rj.^o,b[x,i). It follows by Lemma [TS] that for 6 > 0, Af^ifiRf^^o,b i{x) = 0 for 

X > 0. Therefore, it follows by flA-17p and flA-141) that for 6 > 0, hf^i^i,{x) = ^o,b{x,i) > 0 

2 / 

for 0 < X < xi and h/,j,b(xi) = 


— ^-^^^R"ro^t,{xi,i) = 0. Hence, we obtain that for 6 > 0, 


X — Xi 


<0, 0 < X < Xi- 


(A-19) 


Note that xi > 6 in the case 6 = 0, and that xi < 6 in the case 6 > 0. Therefore, we can find a non¬ 
negative sequence {xi„} with 6 < xin < xi in the case 6 = 0 , xi„ < xi < 6 in the case 6 > 0 , and 
limn_,.oo Xin = Xi such that lim^^oo exists. By replacing x in flA-lOP by xi„ and then 

letting n —>■ oo on both sides of flA-19D gives /c/,b(xi, i; {xi„}) —(/i(xi, i)—//{6 = 0})R” > 

0, which combined with (IA-17D implies hm„^oo ~ <?i-R/,^o.6(xi,i)j 

-|-(yuTxi,i) — 6i) R'r obixi,i) < 0. It follows by this inequality, R'r ob(xi,i) > (see (IA-18IB 
and lim„^oo (due to / G P) that (/i'(xi,i) - 6i) R'j.^^o.bixi,i) > 0, which 

combined with flA-18D implies fi'{xi,i) — 6, > 0. This contradicts the assumption that /i'(xi,i) < 
6i (Condition 2). □ 

Lemma 13.61 We consider any fixed f ^T> and i G iS throughout the proof. We first show that 
there exists a positive sequence {x„} with lim„_,,ooa:n = oo such that for 6 > 0 , 


RlM^n,^)<0■ (A-20) 

Suppose the contrary: for some M > 0, i?"^ 0 . 5 ( 2 ^, f) > 0 for all x > M. This implies R'^^o.bix, i) > 
-|- l,f) > R'j^o,b{M,i) > 0 ioY X > M + 1, where the last inequality follows by the 
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increasing property of Rf^^o,b{-,i) (see Corollary I3.4f iii. As a result, Rf^T^o,b{x,i) > Rf^T,o,b{M + 
1, i) + R'j^o^i,{M + 1, i){x — M — 1) for X > M + 1, which implies hm3;^.oo Rf .^o,b{x, i) = oo. This 
contradicts the boundedness of Rf .^o,b{-,i) fCorollary I3.4f iih 
Write Rf .„o,b i{x) = Rf .^o,b{x,i). By Lemma 1X51 it follows that 


^f,i,bRf,TTO’t>,i{x) = 0 for a; > 0. 


(A-21) 


(i) By Lemma Inl and Corollary 13.41 we can see that is twice continuously differentiable 

on [0, cxd) with the differentiability at 0 referring to the differentiability from the right-hand side. 
It follows by noting R'j.^Q ,,.{b) = R'j, for 6 > 0, and Lemma 1X51 that 

<0 for 6 > 0. (A-22) 


We use proof by contradiction to proye the statement in (i). Suppose that the statement in (i) 
is not true. Then there exists a 6 > 0 and a |/o > 0 such that R'i o b (l/o) = obivo, i) > 0. Let 
{xn\ be the sequence dehned as before. We can hnd a positiye integer N such that xat > t/q. By 
noting R'f .^o,b^i{xN) = R'j .^oA^nR) < 0 (due to flA-20D ). flA-22D and the continuity of R'f^^o,b^i{-), 
we can hnd yi, j /2 with 0 < yi < yo < y 2 < x^ such that 


R'f^T,o,b{yi, 


t) = 0 , 


R'f, 7 T 0 ,b{y 2 ,i) = 0, and R"^^o,b{x,i) >0 for a; G (|/i,|/ 2 ). (A-23) 


Hence, 


R'f,n0.b,i{y2) > R'f,^o.b^i{yi). 


(A-24) 


It follows by flA-2ip and flA-14p that — i{x) = hf^b,i{x) for x > 0. Note that for x > 0, 
I{x > b} = I{x > b} in the case 6 = 0, and that in the case 6 > 0, ^o.b (6, f) = 0 and 

hence, I - R'j,^^o.b{x,i)^ I{x > b} =l - R'j,^^o,b{x,i)^ I{x > b} for x > 0. Therefore, 


for X > 0, 




fTrO,b{x,i) = hf^i^b{x), which combined with flA-23p implies that for x G {yi,y 2 ), 


hf,i,b{yi) — 

hf^i^b{y2) = 


2 


R!f^^o,b{yi,i) = 0 < 

Rl^o,b{y2,i) = 0 < 


a (x, ij 


a (x, ij 


Rf^^o,b{x,i) = hf^i^b{x), (A-25) 

R'f^^o,b{x,i) = hf^i^b{x). (A-26) 


Let {yin} and {y 2 n} be two sequences with yin i yi and y 2 n t ?/2 as n ^ cxo such that 


lim^ 


yin-yi 


and lim. 


f{y2n,j)-f(y2,j) 

y2n—y2 


exist for all j E S. It follows by flA-25p and 
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fe/,i, 6 (yin) fe/,^,b(yi) ^ g ^ fe/,i,6(y2n) /^/,i,b(y2) _ g letting n ^ oo, we obtain 

^^ yin-yi y2n-y2 ° ’ 

fc/,6(|/i,i;{2/in}) -/i(2/i,i)/2"_^o.6(2/i,i) + r^j_^o.6(l/i,*)/{2/i > &} > 0 

and A;/,6(?/2,i;{2/2n}) -/i(|/2, i)i?J„o,b(2/2, *) +//2j,^o,6(i/2, i)/{|/2 > &} < 0 . Therefore, by noting 
R'f^^oAvi^i) = 0 = R'j^^o,b{y2,‘i) (see flA- 23 D i we have 


{ 2 /ln}) > 0 > /c/,6(2/2, h{|/ 2 n}). 


(A- 27 ) 


On the other hand, note that 0 < 5, + g* — < 5* + g, — y'{y 2 , i) (due to the concavity of 

/i(-,f)), R’f^^o.biyiR) < R'^^^o,b{y 2 ,i) (see (| A-24 p), lim„^oo - li^n^oo 

(due to the concavity of f{-,j)). As a result, A;/,6(2/i, {//in}) < 6(2/2, {2/2n}), which is a 

contradiction to (1A-27H . 

(ii) We distinguish two cases: (a) R'j.^o,b{b+,i) > 0 and (b) R”^o^b{b+,i) < 0. 

(a) Suppose R"^o,b{b+, i) > 0. By flA-20p we can hnd A^ > 0 such that xn > b and R'j^o,b{xN, i) < 
0. Then by the continuity of the function R'j,^o,b{-,i) on {b,oo) (see Corollary I3.4f iii we know 
that there exists a 2/2 G {b,X]\f] such that i?"^ 0 , 5 ( 2 / 2 ,0 = 0 and R”^o,b{x,i) >0 for a; G (&, 2 / 2 )- 
We now proceed to show that R"^o,b{b—,i) < 0. Suppose the contrary, i.e., R'^^o,b(yb—,i) > 0. 
By noting R'j,< 0 (see flA-22D i. it follows that there exists a 2/1 G (0,6) such that 
R'f ^o,b{yi,i) = 0 and R'j^o^b{x,i) > 0 for a: G ( 2 / 1 , 6 ). In summary, flA-23D holds for x G ( 2 / 1 , 2 / 2 ) — 
{ 6 }. Rrepeating the argument right below flA-23D in (i), we obtain a contradiction. 

(b) Suppose i7"^o.6(6+, f) < 0. It follows by flA-2ip and the assumption i?^^o, 6 ( 6 , *) > that 


K',Mb-A = = K',^,,(b+A < 0. 

xtb a^{x,t) xib a^{x,z) 


(A- 28 ) 


x^b (J 

We now show that R”^o,b{x,i) < 0 for all x G [0,6). Suppose the contrary. That is, there 
exists some x G [0,6) such that R"^o^b{x,i) > 0. Then by noting i?"^ 0 . 5 ( 0 +,^) < 0 (see flA-22lB 
and R'j^o,b{b—,i) < 0 (see flA-28IB . we can hnd 2/1 and 2/2 with 0 < 2/1 < 2/2 < 6 such that 
R'f^^oAyi^R) = 0> R'f^^o,b{y 2 ,i) = o and R”^^o,b{x,i) > 0 for X G ( 2 / 1 , 2 / 2 )- Repeating again the 
argument right after flA-23D in (i), we can obtain a contradiction. □ 

Theorem 13.71 Note that = 0 given Xq > 6 . Hence, it follows from the dehnition fl3.13p that 

Wffi{x,i) = supE( 3 ,^j) [i?j 5 '^ 0 )] = Rf^TrO,b{x,i) for X > 6 and 6 = 0 . (A-29) 

ttGIT 
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We consider the case 6 > 0. By Lemma [3]6] (ii) we know that R"^o,b{x, i) < 0 for x G [0, b), and 
R'f^o,b{b—,i) < 0. Therefore, it follows by Corollary I3.4f ii that 


= R'f .^o,b{0+,i) > R'j^.^o,b{x,i) > R'j^.^o,b{b,i) > ^ ^ . for 0 < x < 6 . 


1 — c 


1 + d 


(A-30) 


Dehne Wf^i{y,j) = Rf^^o,b{y,i) if j = i, and Wf^i{yJ) = f{yj) if j 7 ^ i. Then by Corollary [Ml^i) 
and Lemma [3.31 we know that Wi{-,j) satishes the conditions in Lemma [5.11 Then by applying 
Lemma 15.11 we know that for some positive seqnence of stopping times {r„; n = 1, 2, • • •} with 
lim^^oo Xn = 00 , the eqnation flA-3j) holds. By letting t in flA-3j) be At, noting that XJ—= 
Cs — > 0, and that given (Xo,.^o) = {x,i), G [0,6) and Wi{X'^_,^s_) = Rj.,^o,b{X^_,i) 


for s < ai A , that 


j fr„Ao-iT^AAt 


+ /o’ 


.'0<s<r„AcriATjJ^Ai 1—c ' JO 1 —c 

and nsing flA-30H . we derive that for any vr G fl, f > 0 and 0 < x < 6, 


iidC. = f, 


_ r-TnAaiT^ A At g-As 


0 


^dC,, 

1 — C 


E 


{x,i) 


I a ^TnAo-, ATAAt,,, (VTT C \ 

' ® ^*l^T„A(TiATAAt’SrnAcriAr^Aij 


L~'o 


T„A(TiAT^Ai r -As 

^ + d Jq 


1 — c 


-dW 


< Rf^^o,b{x,i). 


(A-31) 


Note that the fnnctions (•,_)) and j E S are all bonnded. Hence, the fnnc- 

tions Wi{-,j) j E S are also bonnded. By letting Tn ^ oo and t —>■ oo on both sides of 
(lA-3ip . using the monotone convergence theorem and the dominated convergence theorem and 


noticing that due to for 0 < s < cxi we have 'R{x,i) 




E 


{x,i) 


e Rf^^o,b(h,io)I{T^ < ai} + e /(X,,,,< tJ;} 


and that tt is an arbitrary 


admissible strategy and fl3.13p . we can conclude 


x,i) < Rf .„o,b{x,i) for 0 < X < 6 . 


(A-32) 


Note that {{X^'^,^t)]t > 0} is a strong Markov process and that by the Markov property it 
follows that 

^o,b _ n,b 

r rX ^^1 ip-^s „. ri ' 

A) '^{x,i) 


fX ’ ^,-As 


L -'0 

0,6 


1p—JXs I ‘ b ' ^ p~ 

—nx-^>b},s-l —,c. 


+ e-SK ’ '--^)R.o,b{X^'\ , , e .0,6^ ) 


< Wf^b{x,i) for X > 0, 


(A-33) 


where the last inequality follows by noting 7 r°’^ G H and the dehnition fl3.13p . 
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Combining flA-29jl . flA-32D and flA-33jl completes the proof. 

Proof of Theorem 13.81 We first show that 

R'f^o,b{x,i) < R'.o,b{b,i) = - for a; > 6 , 6 > 0 

i + a 


□ 


(A-34) 


By Lemma iTHlf ii it follows that R'j^o,o{x,i) < 0 for x > 0. As a result, flA-3411 holds for 6 = 0. 
Now supposed > 0. By Lemma l3.3h ii we know that R'j. n A0+. i) = Since ^ 0 , 5 ( 6 , i) = 
it follows by Corollary 13.41 fiii that Rf^T,o,b{-,i) is twice continuously differentiable on [ 0 , cxo) and 
by Lemma 13^ (i) that i?"_Q ^(x, i) < 0 for x > 0. Hence, flA-34D holds for 6 > 0 as well, and 

= R'j.^o,b{0+,i) > R'j^.^o,b{x,i) > R'j^.^o,b{b,i) = for x G [ 0 , 6 ]. (A-35) 


It follows by using flA-34p and llA-35p . and noting / > for s > 0 we obtain that for 6 > 0, 


ii{x:>b}(R'f^M^:_,z) 


1 + d 




= {I-h)i{x: > b}R'f^Mx:_,t) - > 6} - u{x: < 6}i?;^^o,.(x:_,^) 


i-i 


I 


< ^j{x: > 6 } - ^/{x; > 6 } - -^j{x: <b} = 


i+d ^ ^ ^ i+d 

By flA-34p again we can obtain 


1 + d 


1 + d’ 


(A-36) 


R'j^o,b{x,i) < - - for 6 > 0 and x > 6 . 


1 — c 


(A-37) 


Further, note that for 6 > 0 and any f > 0, 


R{x,i) 

^ 'R(x,i) 


/ ^s-)dCs + {Rf,M^:^ ^s-) - RfM^:-^^s-)) 

lJo<s<aiAt 0<s<aiAt 


ro-iAt g-As 


L Jo 


1 — c 


da 


E 


.-A. 


1 — c 


(x; - x;_) 


= E 


{x,i) 


,-A, 


V -dc, 

^ 1 - c ■ 


0<s<aiAt 


(A-38) 


0<s<cri At 

where the last inequality follows by flA-35p . flA-37p . dCs > 0, XJ — XJ_ = Cg — Cg- > 0 and 
dC, = dC, AC, - C,-. 

Dehne Wf^i{yJ) = Rf^^o,b{y,i) if j = i, and Wf^i{y,j) = f{yj) if j ^ i. Then by Corollary 
l3.4f B and Lemma 13.31 we know that the conditions in Lemma 13.31 are satished. By applying 
Lemma 15.11 we know that for some positiye sequence of stopping times {r„; n = 1, 2, • • • } with 
lim„^oo Xn = oo, the equation flA-31) holds for any tt G H, any 6, f > 0 and any n G N. By using 
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(TlAtAT„ 


ds- 


0 l+d 

for 6 > 0. By noting that the functions 


(lA-3p . flA-36[l and flA-38p (setting t = t Ar„) we arrive at Rf .^o,b{x,i) > R{x,i) Jq 

y^aiAtATn ez±_^r< AaiAtAr„.,, V Wtt a 

Z^O 1-C ^ ^ ^/>*l^(TlAtATn ) So-iAtAT„ 

Rf .j,o,b{-,i) and j & <S are bounded and letting t —>■ oo and then n —)• oo and then 

using the monotone convergence theorem for the hrst two terms inside the expectation and 
the dominated convergence theorem for the last term, we obtain that for 6 > 0, Rf^T^o,b{x,i) > 


E 


{x,i) 


/c 


Le- 


- K' SSrdC. + 


By noting W/,i(A'J 5„) = f(X; („) 


0 l+d 

given ,^0 = h fhe arbitrariness of vr and the dehnition of Vf in fl3.6p we conclude Rf .^o,b{x,i) > 
Vf{x, i) for a: > 0. On the other hand, Rf^T^o,b{x, i) < Vf{x, i) for x > 0 according to the dehnition 
dSD. Consequently, Rf .^o,b{x,i) = Vf{x,i) for x > 0. □ 

Proof of Lemma 13.91 Recall that is dehned in fl3.12p . By Theorem 13.71 it follows that for 
any large enough b and any x > 0, 

[I 1 ■ 


Rf^^o.b{x,i) = Wf^b(x,i) = supE(^,i) 


tGII 


l + d 


■da 


+ < ai} + ,a)/{cri < 


> sup Ex 

ttGII 




p-As 


ds — 

^ + d Jq 


dC, + e-''-./(A'+„)/{<A<Tj'} 


X t u ./n 1 — C 

Note limfo^oo = oo and / is bounded. Then it follows by letting 6 —)■ oo on both sides, 
and then using the monotone convergence theorem twice and the dominated convergence that 
liminfb^oo %^o.b(x, i) > sup^gn + e-a/(X^^, ^i) = 'C/(x, i) 

for X > 0. This combined with the fact Rf .^o,b{x,i) < Vf{x,i) for x > 0 completes the proof. □ 
Proof of Theorem 13.101 IB > 0 is obvious by the dehnition. We just need to prove b{ < oo. 
Suppose the contrary. Then by fl3.14p we have R'j.^o,b{b,i) > for all 6 > 0. Hence, it follows 
by Lemma EH] that Vf{x,i) = limb^oo Rf .^o,b{x,i) for x > 0. For any & > 0, by Theorem 13.71 we 
know ^ 0 , 6 (x, i) > for X G (0, 6], which implies i?j^^o.f,(x, z) > Rf^x,o,b{0,i) +for x E (0,6]. 
Hence, for any x > 0, we can hnd a 6 > x such that Vf{x,i) > Rf .^o,b{x,i) > Rf .^o,b{0,i) + 
Hence, hma;_^oo h/(x, z) = +cxo, which contradicts Vf{x,i) < for x > 0 (see Lemma EH]), 

(ii) is a result of (i) and Theorem 13.81 □ 

Proof of Theorem 14.11 (i) Dehne an operator V by 


P(/)(x,z) := Vf{x,i), X > 0,z G iS and f eC. 


(A-39) 
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Then by Theorem 13 .1 01 we have, 


V{f){x,i) = Vf{x,i) = R ^^f{x,i), X > 0,i E S and f eC. (A-40) 

f,Tr ’ * 

Recall that "D C C and ("D, 11 • 11) is a complete space. We will hrst show that P is a contraction 
on {V, II • II). Consider any f E V. It follows by Lemma and flA-dOll that V{f) = Vf E C. 
Note that for any f E T> and i E S, b{ < oo according to Theorem 13.101 Further notice that 
by Lemma 1X51 (ii), we know R'j .is continuous in b and i?^^o,o(0+,i) = by 

Corollary 13.41 fib Hence, according to the dehnition of b{ in fl3.14p . we have R' ^f{b{,i) = 

Therefore, it follows by Corollary 13.41 that for any i E S, the function R twice 

Ftt ’ * 

continuously differentiable on (0, cxd) and by Lemma ITRl til that R is concave. Notice 

/a ’» 

that by Corollary |331 (i) again R' ^^^(0+,i) = Hence, £V{f){x,i) = R' < 

’ * />•"■ ’ * 

R' f (0+, i) = for X > 0, which results in < i for 0 < x < y. Therefore, 

r 0 ^ ' ’ / 1—c ’ x—y — 1—c — ^ ’ 

J,7T ’ ^ 

we can conclude V{f) E V. For any /i, /2 G T*, if follows by flA-39p that 


sup Rf^^.„{x, i) — sup i) 


\\v{h)-v{m 

= sup \VfAxA) — VfAxA)\ = sup 

{x,i)m+xS {x,i)eR+xS 

< sup sup |R/i,^(x,i) - R/ 2 ,^(x,i)| sup | |/i -/ 2 I |] 

(x,i)GR+x<S ttGII (x,i)GR+xi? 

= II/1-/2I1/ = max—^ll/i -/ 2 II, (A-41) 

Jo Qi + di 


where the last inequality follows by fl3.5p and the last equality follows by noting that cxi is 
exponentially distributed with mean W Therefore, P is a contraction on the space (P, || ■ ||). 

Note that for any f E C and i E S, is non-decreasing. Hence, it follows by fl3.5p 

and flA-40D that the operator V is non-decreasing. Consider two functions gi,g 2 dehned by 
yi(x, i) = 0 and g 2 {x, i) = jjjAd)- ^f hard to verify that gi, g 2 eV and yi < H < g 2 - Hence, 
P(5'i) < < 'P{ 92 )- Note that by fl2.4p V{V) = V. Hence, P(yi) <V< V{g 2 )- Apply the 

operator V once again, we have P^(yi) < H < P^(y 2 )- By repeating this n — 2 more times, we 
obtain P"'(yi) < V < P"'(y 2 )- As a result, hm„_j.P"(yi) < V < hm„^ooP”(y 2 )- Since P is a 
contraction on the complete space (P, 11 • 11), there is a unique hxed point in P and is identical to 
both lim„^ooP”(5'i) and lim^^oo P’^(y 2 )- Consequently, lim^^oo P”( 5 ' 2 ) = V = lim„^oo P''( 5 ' 2 )- 
As a result, V eT). (ii) The results follow immediately by (i) and Theorem 13.101 □ 
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Proof of Theorem 14.21 Since, bf < oo for all i E S, we can define an operator Q by 


Q(f)(x,i) = R ior f eC, X > 0, and i E S. 


(A-42) 


The function R n 6'^ is obviously nonnegative according to its definition. It follows by Lemma 
13.21 that R obV <Vf < and by Corollary 13.41 that the function R obvi-,i) is increasing. 

O(H-Ct) -F' 


r u,o: 


Therefore, R o ,,y G C. Then by flA-42p we know Q{f) E C. It follows by fl3.5p that 

||Q(/i) - Q(/2)|| = sup \R o,bv{x,i)-R o,bv{x,i)\ 

(a:,i)eK+x5 

< sup [e"^"i||/i -/2II] 

(a:,i)GK+ xE 

= II/1-/2II /“«.e-»‘e-«d( = max-^||/i-/2||. 

Jq Qi + Oi 

Consequently, Q is a contraction on (C, || ■ ||). Hence, there is a unique fixed point of Q on 


(C, II ■ II). Note by flA-42p we have Q{y){x^i) = R^ o^bY{x,i) = V{x,i), where the last equality 


follows by Theorem 14.11 (ii). Therefore, H is a fixed point. By flA-42p and noticing that 
and 71* are identical before Ui, we have 


Q{R^*){x,i) = R o,bY{x,i) 

iX ^* ,TT 


= E 


{x,i) 


f*(Tl 7 * 


r-cri 


.-At 


L~'o 


1 + d 


-dcr 




, a: > 0 , i 6 iS, 


(A-43) 


(A-44) 


where the last equality follows by fl3.5p . It is not hard to see that the process {X'^*, J) is a 
Markov process. Hence, it follows by the Markov property that 


R-K*{x^i) E^a-j) 


r-cri 7 * 

‘ :dt 


r-fTi 


.-At 


Lao 


1 + d 


1 — c 


-da* 




, a: > 0 , i G iS. 


(A-45) 


Combining flA-44D and flA-45p we obtain Q{R.„*){x,i) = Rt,*{x,i), a: > 0,i G 5. Therefore, 
is also a fixed point. As there is a unique fixed point, we conclude V = i?^». □ 
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